Coding for Numerical Data Transmission* 
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(Manuscript received June 2, 1966) 

This paper considers the effectiveness of error-correcting codes for the 
transmission of numerical data. In such a situation, errors in the nu- 
merically most significant positions of a message are of greater con- 
sequence than are errors in the less significant positions. A measure 
of transmission fidelity based upon the average magnitude by which the 
numbers delivered to the destination differ from the transmitted numbers 
is developed and is referred to as the average numerical error (ANE). Codes 
are compared by comparing the ANE that results from their use. 

Significant-bit codes are defined and the ANE resulting from their use 
is determined. For constant-symbol-rate transmission, the relative effect- 
iveness of various coding schemes is analyzed when the error probability 
in the channel is small. The ANE resulting from the use of certain specific 
codes is numerically evaluated and compared. 

I. INTRODUCTION 

The usual approach to coding is to ignore the actual meaning of the 
transmitted symbols and to represent them in a purely statistical 
manner. As a result, all message errors are assumed to be equally 
costly and codes have been sought that simply reduce the probability 
that a message is received in error. 

While this may be appropriate for the transmission of some types 
of data, there are situations in which other criteria of goodness are 
of greater merit. If, for example, one is interested in the transmission 
of the temperature of a satellite, the probability that a particular 
observation is transmitted incorrectly may have little direct relation 
to system performance whereas a measure of the average magnitude 
by which the received data differ from the data actually transmitted 
could prove useful. 

* The material presented in this paper is based upon the dissertation, Coding 
for Numerical Data Transmission, submitted by the author to The Johns Hopkins 
University in conformity with the requirements for the degree Doctor of 
Philosophy. 
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This paper develops a criterion of transmission fidelity for numeri- 
cal data transmitted over a binary symmetric channel based upon the 
average numerical error which occurs. Significant-bit codes are de- 
fined and the average numerical error resulting from their use is de- 
termined for a binary symmetric channel with independent errors. For 
constant-symbol-rate transmission, the relative effectiveness of various 
coding schemes is analyzed when the probability that a symbol is 
received in error is small. In order to obtain a feeling for the utility 
of coding, the average numerical error resulting from certain specific 
codes is numerically evaluated. 

II. PRELIMINARIES 

Throughout this paper, the channel is taken to include all operations 
performed upon the symbols during transmission. A binary symmetric 
channel is defined to be a binary channel such that 

(i) the channel always gives one of the binary symbols at its output, 
(tt) the probability that any particular sequence of errors occurs is 
independent of the symbols transmitted. 

In some sections, we shall consider a binary symmetric channel with 
independent errors. This is a binary symmetric channel for which 
the errors occur independently with probability p where ^ p ^ \ 
and p = 1 — q. 

The elements of the Galois field of two elements are denoted by 
and 1. Let the symbol denote component by component modulo 2 
addition of vectors (or n-tuples) whose components are field elements. 
The set of all such vectors forms a vector space r of dimension n over 
the field of two elements. Because a field element can be viewed as a 
vector with one component, © will also be used to denote the addition 
of field elements. 

A binary group code 7 is a subset of T which forms a group. Over 
the field of two elements, any set of n-tuples that forms a group is 
indeed a vector space. Therefore, a binary group code V forms a sub- 
space of T. The dimension of V is k. 

The implementation of a binary group code can be viewed in the 
following manner. The encoder receives k binary information symbols 
(called a message) from the source and determines from the message 
(n — k) binary parity check symbols (called an ending). The message 
and ending may be interleaved or transmitted sequentially to form a 
block of length n (called a code vector). The decoder operates upon 
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the blocks of n binary symbols coming from the channel in an attempt 
to correct transmission errors and provides k binary symbols at its 
output. The notation (n,k) is used to denote such a code. 

Consider the message (m k , m k -i , • • • , m,). The code vector used 
to transmit this message will have m k , m t _i , • • • , m x in the k informa- 
tion positions. The (n — k) parity check positions that form the ending 
are denoted by e, , e 2 , ■ • • , e„- k . The order in which the information 
positions and the parity check positions are arranged for transmission 
is arbitrary. 

Let H denote the parity check matrix for a binary group code. H 
is an (n — k) X n matrix whose entries are field elements. An n-tuple 
v is a code vector if and only if 

vff = 0, (1) 

where ft denotes the transpose of H. H can be written in a form such 
that each column of H that corresponds to a parity check position in a 
code vector is a distinct weight* one {n — fc)-tuple. When this is done, 
let Cj(l ^ I ^ k) denote the column in H that is in the position that 
corresponds to position m t in a code vector. 

For a binary symmetric channel, the order in which symbols are 
transmitted can affect code performance. For the binary symmetric 
channel with independent errors, the order in which symbols are trans- 
mitted does not affect performance. In the latter case, we can write 
H as 

H = (C* ,C fc _, , ••• ,CJ n - k ), (2) 

where I„- k denotes the (n — k) X (n — k) identity matrix. 

III. FORMULATION OF A CRITERION OF CODING EFFECTIVENESS 

A system for transmitting observations performed upon some physical 
process over a binary channel is shown in Fig. 1. So that the relation- 
ship between the observed numbers and the code will be clear, a general 
formulation will be presented. 

If each quantization step is of uniform size, the quantizer output 
can be represented as A -\- Bi where A and B are constants and the 
integer i indicates the quantization level. The "source scale-to-binary 
converter" receives A + Bi from the quantizer and transmits i to 
the encoder. The "binary-to-source scale converter" receives some 
integer j from the decoder and delivers A + Bj to the destination. 

* The weight of a vector v is the number of nonzero components in v and is denoted 
by u>[t>]. The distance between two vectors u and v is w[u v]. 
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Fig. 1 — System, model. 



Let Pr (; | i\ be the probability of receiving ;' at the decoder output 
when i served as the encoder input and let Pr \i\ be the probability 
that % is sent. The average numerical error (ANE) that occurs is 

ANE = ZEl(^+fii)-(^+ Bt) | Pr {j | i] Pr {i} . (3) 

If all values of i are equally likely to be observed and if the range 
for i is ^ i ^ 2* - 1, Pr \i\ = 2~*. The range for ; is thus ^ j ^ 
2* — 1 and (3) becomes 



B 



2*-l 2*-l 



ANE = SZI |i-t|PHJ|»|. 

^ t=0 1=0 

Because B is a constant not dependent upon the particular coding 
scheme implemented, B may be set equal to 1 when comparing the 
effectiveness of different codes. Accordingly, we shall consider the 
expression 

ANE = i ZLli-HPr lilfl. (4) 

Ii ,-=o ,=0 

For a specified value of &, a given coding scheme is considered perferable 
to some other coding scheme if the ANE resulting from the implementa- 
tion of the given code is less than the ANE resulting from the alternative 
code. 

The code enters (4) through the terms Pr {j | i). Thus, for a binary 
symmetric channel, the ANE will, in general, be dependent not only 
upon the error statistics of the channel but also upon the order in which 
the symbols are transmitted. 
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It is possible to simplify (4) to an expression that involves terms of 
the form Pr {;* | 0} exclusively. This reduces the number of terms by a 
factor of 2* and demonstrates that knowledge of the error probabilities 
conditional upon zero being sent is sufficient to evaluate the ANE. 
However, it is necessary to develop some notation and to present two 
lemmas before proceeding to simplify (4). The proofs of the lemmas are 
omitted because the lemmas follow from the group property of the 
code. 

When the integer i is to be sent, let us assume that the message 
ultilized is the fc-bit binary representation of i (which is denoted by 
B{i)) such that 

B(i) = (to* , w,_, , •• • , to,), 
where 

i = m k -2 k - 1 + mi-,-2*"* + •■• + m . 

The ending E { = (e, , e 2 , • • ■ , e,,-*) required to encode B(i) is chosen 
so that the resulting code vector C(i) satisfies (1). 

Lemma 1: For any values of the integers i and j, ^ i ^ 2* — 1 and 
^ j ^ 2* — 1, there exists an integer I such that Pr {j \ i\ = Pr [I [ 0| 
where B(l) = B(i) B(j) and ^ I ^ 2* - 1. 

Lemma 2: I jet B{1) = B(i) B(j) as in Lemma /. For fixed i(0 ^ 
i ^ 2* — 1), as j successively takes on the values 0, 1, 2, • • • , 2* — 1, I 
takes on each of the values in the range ^ I ^ 2* — 1 once and only once. 

Theorem 1: Let all messages be equally likely to be transmitted and let 
the channel be binary symmetric (but not necessarily with independent 
errors). For these conditions, the average numerical error is 

ANE = £2'- 2 Pr {» | 0} . (5) 

1=1 i=2>-' 

Proof: By Lemmas 1 and 2, for each value of i and for a specified 
value of /, there will be a unique integer j t such that Pr j ;, | i \ = Pr { I | J 
where B(l) = B(i) B(j,). From (4), 

ANB-i'z! Eli. -t|Pr{/|0}, (6) 

^ 1-1 i=0 

where we have used the fact that \ ji — i \ = when I = 0. 

For each value of I (1 ^ I ^ 2* — 1), we wish to determine 
_C?-V \ h ~ i I- Let a(0 ^ a ^ A" — 1) be the largest integer such that 
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2" ^ I. Define i' and ft as 

B(jd = B(i') © B{2") (7a) 

B(0 = B(i\) ©5(2°) or B(fi = B(i)@B(2"). (7b) 

Then 

Bii) © BO",) = B(i') © Btf) = B(l) . (7c) 

Because Z > 0, i ^ ji and i' 7± ft . Suppose i > j t . Then j, = i' - 2" 
and # = i ' — 2 a by (7). It follows that j t - i = -2" — i + *' and 
j\ - i' = —2 a + i - i'. Conversely, if i < ji , ji = i' + 2° and i\ = 
i + 2". Thus, j t - i = 2" - i + i' and j{ - i' = 2 a + i - i'. 

Therefore, 

I h - i I + I ji ~ i' I = I 2 a + » - %' | + | 2 a - » + »' |. (8) 

But B(t) = B(2 a ) © 5(0 © B(*') by (7). Thus, \ i - i' \ < 2" and, 
from (8), 

|ji-*| + |fl-*'l - 2-2". 
Because of the symmetries involved, 

2 Z | Ji " t | = Z | j, - t | + | ;{ - *' | - 2 fc -2" + 1 . 

i-0 f=0 

Thus, (6) becomes 

2*-l 

ANE = Z2 a Pr {Z|0} 
or 

ANE = E 2 a 2 Z ' Pr {Z | 0} . QED 

a=0 i=2" 

In (5), notice that Pr JO | 0} does not appear and that the terms Pr \i \ 0} 
are not weighted linearly in i but that the weighting coefficients go 
in steps as powers of 2 with several conditional probabilities having 
the same weighting coefficient. Notice that the weighting coefficient 
for Pr {i | 0} is 2 ,_1 where (j - I) is the largest power of 2 in i. All errors 
with the same coefficient are of the same seriousness and a good code 
must reduce these sets of probabilities rather than simply minimize the 
probability that a few very large errors occur. 

Because the set of messages B(i) (2' _1 £ < £ 2' — 1) gives rise to 
the set of conditional probabilities whose weighting coefficient in the 
ANE expression is 2'" 1 , we shall call these messages the j-level messages 
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and the corresponding conditional probabilities, Pr {2' -1 | 0} through 
Pr {2' — 1 | 0} , the j-level conditional probabilities. The 0-level message 
is denned to be B(0) and the 0-level conditional probability to be 
Pr {0 | 0). 

The ;-level messages have the following interesting characteristics. 

(i) Component m, in each message is 1. 
(w) Components m<(j + 1 ^ i % k) in each message are 0. 
(lit) Every possible (j — l)-tuple occurs once and only once as com- 
ponents m x through m,_, of some ;-level message. 

For a perfect error-correcting code used with a binary symmetric 
channel with independent errors, it is possible to compute the j-level 
conditional probabilities and thus the ANE from a knowledge of the 
weight distribution of the code vectors on each level (these weight 
distributions have been referred to as level weight structures.) 1 The 
problem of efficiently computing the level weight structures from knowl- 
edge of the parity check matrix has been discussed previously. 1 

IV. SIGNIFICANT-BIT CODES 

In order to permit the error-correcting capabilities of a code to 
correspond somewhat to the significance of the information positions, 
it is possible to formulate a type of code which uses a subcode to protect 
the (/c — k ) most significant positions of a message and simply transmits 
the remaining symbols unprotected. The name significant-bit code 
(SB code) is used for this type of code. An SB code is specified by the 
parity check matrix H SB and the ANE resulting from the use of an 
SB code is ANE 8B . 

The code utilized to protect the (k — fc ) most significant informa- 
tion positions will be named the base code. Because it is confined to 
the (k — k ) most significant positions, we can abstract the base code 
and study it as a separate entity. Accordingly, the base code vectors 
are (n — A- )-tuples of which the first (k — k ) positions are the base 
messages. 

Although the concept of SB codes is applicable to any binary sym- 
metric channel, we shall assume independent errors in the following 
analysis. Thus, from (2), the base code is specified by the base parity 
check matrix H B where 

In this case, the code vector C(i) = B(i) \ E t where the symbol | 
indicates that C(i) can be partitioned into the fc-tuple B(i) and the 



1032 THE BELL SYSTEM TECHNICAL JOURNAL, MAY-JUNE 1967 

(n - fc)-tuple E t . Let B(i) be partitioned so that B{i) = B'{i') \ B"{i") 
where B'ii') denotes the (fc - k ) most significant positions of B(i) 
and B"(i") denotes the k least significant positions of B(i). Then 

C(i) = B'(i') I B"{i") | £', . 

The range for i' is g z' ^ 2*"*' - 1 and for i" is ^ i" ^ 2*° - 1. 

Let Pr B [if | j'} denote the probability of receiving i' when f is sent 

using the base code. By Theorem 1, the ANE for the base code (ANE B ) is 

ANE B = Zr 1 Z Pr„ {*' I 0j. (9) 

,=1 i'-2l — 

Because the base code is used exclusively to protect the (k — K) 
most significant information positions, H SB must have the form 

H n - (CU. , CU_, , • • • , CI , C[ 0_ ;1 /„-,) 

A'n 

columns 

where is used to represent an all-zero column of H BB and where 
the CJ(1 ^ I ^ & - k ) are the columns of H B . The coset leaders 2 
in the standard array 2 for the SB code must be obtained from the 
coset leaders in the standard array for the base code by expanding the 
base coset leaders in length to n-tuples by inserting k zeros in informa- 
tion positions 1 through k of the expanded vectors. Because all vectors 
in column i of the standard array for the SB code will have B"(i") 
in information positions 1 through k , 

Pr |t |0| = p-i*""""^- 1-"«"»> Pr B (i' | 0|. (10) 

We shall now show that ANE SB can be expressed in terms of the 
properties of the base code. 

Theorem 2: Let the base code be defined as above. For a binary symmetric 
channel with independent errors and when all messages are equally likely 
to be transmitted, 

ANE 8n - Pr„ {0 | 0} £ 2'- V°- y + 2** ANE„ . (11) 

Proof: Define 

ANE' = £ 2'-' 2 Pr (*' I °) 
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and 

ANE" = 2 2 '~' 2 Pr 1*10}. 



|-te+l 



From Theorem 1, ANE 8B = ANE' + ANE". 

Let us first analyze ANE'. For 1 £ j £ fco , the sum of the j-level 
conditional probabilities is 

E Pr [i | 0} = E p"" B " (< "V"" lfl " (, " )1 Pr„ {0 | 0) 

,=2<-' i"_2i-' 

where we have used (10) and realized that i' = for all messages on 
this level. Because every (j — l)-tuple occurs as components m, through 
m,-! of some j'-level message and m, = 1 in every j'-level message, 
there are 

i - i 

MB"(i")] - 1. 
messages of weight w[B"{i")] on the /-level. Thus, 

E Pr (t | 0) = Pr B [0 | 0| E ( J ~ JjpV-' 

- Pr B 10 | 0)pq k '- i 

and 

to 

ANE' = Pr„ {0 |0) E2'"W""'. 

Now consider ANE". On level fc + £(l^£^ fc - fc <>)> * has the 
range 2* 0+£-1 £ * £ 2* ,+ * — 1. Divide this range into 2 £_l sets of con- 
secutive integers each of size 2*°. Let the integer 5 index these sets 
where ^ 5 ^ 2 £_l — 1. For a particular value of 8, as i increases 
from 2*° +£ - + 52"' to a***" 1 + (5 + 1)2*° - 1, i' = 2 ( ~ l + 5 and i" 
runs through the range ^ i" £ 2*' — 1. Thus, using (10), 

2 *o+f-i + (J + i)2*»-l 

E i^ (* I o} 

1=2 to + f-i+J2to 

= 2 ^' p , l «-(,",) 9 ;-„-,,«"(.")i Pl . B | 2 I- + a |o|. 

,-•-0 

As i" runs through the range ^ t" ^ 2*" — 1, each possible A; - 
tuple occurs once and only once. Therefore, 
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V Pr U I 0} = Pr B {2^ + 5 | 0} E / tV' 

= Pr B {2 { -' + 8 |0}. 

Because of the manner in which the sets were chosen, ANE" can be 
expanded as 

*-*„ zf-'-l 2*°+t-' + (J-H)2*°-l 

ANE" = E 2 t0+f_1 E Z Pr I* \ 0}. (13) 

f_l « = ,=2*» + f-"+*2* e 

Substituting (12) into (13), we obtain 

ANE" = 2 k ° *E 2*" 1 E Pr B [*' \ 0} 

£=1 i'=2t-> 

which, from (9), is exactly 2* 8 ANE B . QED 

Notice that the situation k = k can be included in this formulation 

if we define ANE B = and Pr B {0 | 0} = 1 when k = k . Thus, uncoded 

transmission can be regarded as an SB code in which k = k Q . 

The interpretation of (11) is interesting. The quantity E>-i 2 ,_1 p? fco ~' 

is the ANE that results from the uncoded transmission of fc -tuples. 

Thus, ANE SB is the ANE for uncoded transmission of /c -tuples weighted 

by Pr B {0 | 0} plus 2*° times ANE B . 

(11) enables the computation of ANE SB from the properties of the 

base code. Because the base code involves messages of length {k — k ), 

it is easier to analyze than the entire SB code. 

V. CONSTANT-SYMBOL-RATE TRANSMISSION 

Consider two error-correcting codes which are denoted as V\ and 
V 2 . Let V t be an (n, , k) code and V 2 be an (n 2 , k) code where n x 
may or may not be equal to n 2 . Let £i denote the minimum weight 
of the n^tuples that are not coset leaders in the standard array for 
Vj . Similarly, let e 2 denote the minimum weight of the ?i 2 -tuples that 
are not coset leaders in the standard array for V 2 . 

For a binary symmetric channel with independent errors, Pr {% \ 0} 
for Vi is 

Pr {i | 0} = E r< i p i q'"- i 

where t,, is the number of w,-tuples of weight j in the column headed 
by C(i) in the standard array for V x . Thus, for 7 X , the average nu- 
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merical error (ANE,) is 

ane, = z *,y<r~ , \ 

where 



k 2'-l 

», = Z 2'- 1 Z r„ . 

1-1 .=2'-> 

Similarly, for V 2 , 

ANE 2 = Z^pY""', 

where the 7, are the appropriate constants. 
However, 

ANE, — > <r c ,p"q ni ~" as p — > 

and 

ANE 2 — » y c ,p c 'q"~ c ' as p — > 0. 

Thus, for p sufficiently small, if £, > e 2 , ANE, < ANE 2 and 7, 
results in less ANE than V 2 . 

The minimum weight of the vectors that are not coset leaders in an 
SB code is 1. Thus, consider two SB codes denoted by Fsbi and V BB2 
where F SB i is an (n, , k) code and V BB2 is an (n 2 , k) code. V H bi protects 
the (k — k i) most significant positions and V BB2 protects the (k — k 02 ) 
most significant positions of a message. By reasoning analogous to 
that above, for p small, if k 0l < fc 02 and if the base codes used in V 8B i 
and V BB2 correct all weight one errors, then V BB1 results in less ANE 
than F 8B 2 • 

We thus have the following ranking of codes for p small. The ranking 
(in order of increasing effectiveness) assumes that the schemes are 
compared for the same value of A;. 

(1) Uncoded transmission. 

{ii) An SB code protecting (k — k ) positions where k 5^ k . 
(Hi) An SB code protecting (/c — k + k') positions where k' > 0. 
(iv) An e-error-correcting code where e ^ 1. 
(v) An (e + e')-error-correcting code where e' > 0. 

To obtain a feeling for the utility of coding for numerical data trans- 
mission over a binary symmetric channel with independent errors, the 
ANE resulting from certain codes for k = 26 will be evaluated for 
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constant-symbol-rate transmission. Ref. 3 contains similar information 
for k = 1, 4 and 11. 

Let ANE UC denote the ANE when no coding is used. Contrary to 
the concept of code equivalence that is obtained under the assumption 
that all errors are equally costly (i.e., when probability of message 
error is used as the measure of code performance), the ordering of the 
columns of the parity check matrix can affect code performance. Thus, 
for the (31, 26) perfect single error-correcting code (PSEC code), every 
ordering of the columns of the parity check matrix could yield a distinct 
ANE. Upper and lower bounds on the ANE for this code are obtained 
in Ref. 3 and are denoted herein as ANE DB and ANE LB , respectively. 

By numerical computation, the ordering in (14) was found to result 
in as small an ANE as any other ordering tried. The number actually 
tried was by necessity a small fraction of all possible orderings of the 
26 columns. However, notice that C12 through C 28 each have a one in 
the same position thus assuring us that the number of weight three 
code vectors on levels 12 through 26 will be the theoretical minimum for 
this code (by Theorem 9 in Ref. 3). For values of p that are of primary 
interest (less than 10 _1 ), this assures us that it is not possible to find 
a different ordering that will result in a significantly better performance 
(although there are other orderings that in fact give equal performance). 
Let ANEp denote the ANE that results from the code specified in (14). 



H P = 



1111111111111110000 000000 
11111111000000011111110000 

11110000111100011110001110/5 

11001100110011011001101101 
1010101010101011010 1011011 



(14) 



If the columns of (14) are regarded as the 5-bit binary representations 
of integers, then the ordering from left to right corresponds to decreasing 
integer value (with powers of two omitted because they appear in I 5 ). 
Similar ordering was observed to be preferable for the (15, 11) PSEC 
code 3 and, by exhaustive search, actually found to be as good as any 
other ordering for the (7, 4) PSEC code 3 . 

Table I compares ANE LB , ANE UB and ANE P . For convenience 
(and so that the values given will agree with the data plotted in Figs. 
2, 3, and 4), the ANE has been normalized by dividing by 2 26 - 1 
(i.e., the full-scale value). 

The following SB codes are considered. For each, H B and the nota- 
tion used for the resulting ANE in Figs. 2, 3, and 4 is given. Theorem 
2 permits the computation of the ANE for these codes from a knowl- 
edge of the base code. 
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Table I — Values of ANE lb , ANE UB and ANE p 
Divided by 2~ a — 1 



l> 


ANElb 


ANEp 


ANE 0B 


io- & 
io-< 

10~ J 
10" J 

io-» 


0.41992- 10-" 
0. 41920- 10~ 6 
0.41212- 10"* 
0. 34850- 10~ 2 
0.90222 10-' 


0.41994-10- 8 
0. 41931 -10- 6 
0.4131010- 4 
0. 35659 -10- 2 
0.10446 


0. 42993 -10- 8 
0.42932- 10"* 
0.42329- 10- 4 
0. 36894-10-' 
0.12817 



Base Code 1: (3, 1) PSEC code. 

H B = 



/, 



The ANE is denoted as ANE,,,,, . 

Base Code 2: (5, 1) perfect double error-correcting code. 



H B = 



U 



The ANE is denoted as ANE (a .„ . 

Base Code 3: This base code uses independent (3, 1) PSEC codes to 
protect the two most significant information positions. 



H H = 



1 

1 

1 

10 1 



U 



Because the codes are used independently, the required conditional 
probabilities for the base code can be readily calculated. The ANE 
is denoted as ANE (3 ,,, , (3 ,,, . 

Base Code J,: (7, 4) PSEC code. 



The ANE is denoted as ANE (7i4) . 

Base Code 5: This base code uses a (3, 1) PSEC code to protect the 
most significant information position and a (7, 4) PSEC code to protect 



1 


1 


1 





■ 


1 


1 





1 


h 


[l 





1 


1 
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the next four most significant information positions. 



Hn = 



10 

10 

1 1 1 h 

110 1 

10 1 1 1 



The ANE is denoted as ANE <3il) , (7 .4> . 
Base Code 6: (15, 11) PSEC code. 



H B = 



11111110000 
1 1 1 10001 1 10 
11001101101 
10 10 10110 11 



h 



The ANE is denoted as ANE (l5lll) . 

Figs. 2, 3, and 4 present ANE UC , ANE UB , ANE LB , ANE P , and 
the ANE of the SB codes considered. In each case, the ANE has been 
normalized by dividing by 2 26 — 1. For clarity, logarithmic scales are 
used as p decreases from 10" l until p becomes sufficiently small so 
that the results for small p apply. 

The following observations can be made for constant-symbol-rate 
transmission. 

(i) Improvements in transmission fidelity are obtainable by the 
utilization of codes. It should be noted that no one code is the most 
desirable for all p (0 < p < \) and in some cases the codes that are 
best for small p turn out to be less effective than uncoded transmission 
for the larger values of p. 

(ii) For A; = 26, it can be shown that the probability that a message 
is received in error when the PSEC code is used is less (for < p < %) 
than the probability that a message is received in error using any of 
the SB codes considered. Thus, under the criterion of minimizing the 
probability that a message is received in error, the PSEC code is pref- 
erable to any of the SB codes considered. 

However, when the ANE is used as a measure of code effectiveness 
for numerical data transmission, we observe that the SB codes are 
preferable to the PSEC code for certain values of p. Thus, when com- 
paring codes, the ranking obtained using probability of message error 
as the performance index may not correspond to the ranking obtained 
using ANE as an index. We can conclude that probability of message 
error and ANE are not equivalent measures of code performance and 
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Fig. 2 — Constant-symbol-rate transmission; k = 26. 



that, in some cases, the ANE can be reduced by using a code whose 
probability of message error is not minimal. 

(iiz) For k = 26, consider the relative performance of the PSEC 
code and the SB codes. When p is small, the PSEC code will be effective 
because it can correct all single errors (the only type that have much 
probability of occurring) whereas a single error in certain positions 
of an SB code will result in a message error. For larger values of p, 
there is an increasing chance that an error pattern will occur which the 
PSEC code cannot correct. The SB codes become effective in this situa- 
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tion. If multiple errors occur during transmission such that the errors 
occurring in the (k — k ) most significant information positions and the 
check positions form an error pattern correctable by the base code, 
this will be corrected leaving any errors in the k least significant 
information positions uncorrected. Therefore, the most costly portion 
of a large number of error patterns can be corrected. As p increases, 
the number of positions in the base code must decrease so that un- 
correctable error patterns in the positions covered by the base code 
have a sufficiently small probability of occurrence so that the base code 
can operate effectively. In other words, as p increases, more and more 
protection must be provided for the significant bits so that the most 
costly errors are prevented. 
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Fig. 3 — Constant -symbol-rate transmission; k = 26. 
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Fig. 4 — Constant-symbol-rate transmission ; k = 26. 

(iv) For p small, the ANE from uncoded transmission is approxi- 
mately (2* — l)p. For small p, the ANE as a fraction of full scale for 
uncoded transmission is thus very nearly independent of k. 
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